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ABSTRACT 

In preparation for a major research study on change 
in schools, a 3~month pilot study of principals in 10 schools was 
conducted in central Texas. The main purpose of the study was to 
investigate different ways to document the actions taken by the 
principals to facilitate implementation of innovations in their 
schools. In this paper, the procedures and methodology of the pilot 
si 1y are described, followed by analysis of the relative strengths 
and weaknesses of the five data collection procedures tested: (1) a 
written log maintained weekly by the principal; (2) a weekly report 
submitted via audio tape; (3) weekry reports over the telephone; (4) 
a monthly face-to-face "game plan** interview; (5) a face-to-face 



for the collection and analysis of qualitative data are discussed. An 
appendix provides an overview of the major study and its procedures. 
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A PILOT TEST OF METHODS FOR DOCUMENTING PRINCIPAL INTERVENTIONS^ 

Teresa Griffin 
Mdrcia Goldstein 
Gene E. Hall 

Research and Development Center for Teacher Education 
The University of Texas at Austin 

In preparation for a major research study on change in schools, a three- 
month pilot stucjy was conducted in ten schools in central Texas. This pilot 
study was conducted for several purposes, the main one being to investigate dif- 
ferent ways of collecting information about interventions that school principals 
make as they are facilitating implementation of innovations in their schools. 
Previous studies done by the CBAM Project at the Research and Development Center 
for Teacher Education had used ethnographic techniques for collecting informa- 
tion about the actions of principals and other change facilitators; this pilot 
was designed to test alternative methods of intervention documentation based on 
self reports by principals. 

PERSPECTIVES AND ASSUMPTIONS 

Several perspectives and assumptions, based on previous research, have 
guided the design of our studies ovar the years. These assumptions and the 
framework for the research described here have their foundation in the 
Concerns-Based Adoption Model (CBAM), which was developed at the Research and 
Development Center for Teacher Education at The University of Texas. 



The research described herein was conducted under contract with the 
National Institute of Education. The opinions expressed are those of the 
authors and do not necessarily reflect the position or policy of the National 
Institute of Education, and no endorsement by the National Institute of 
Education should be inferred. 
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A key premise of the CBAM is that change is a process . It occurs over 
time, and is facilitated not by one or two "events," e.g., a mandate by the 
district or a "hit and run" workshop, out by a series of actions or events, 
called interventions, which influence individuals and their use of an innovation 
over time. Therefore, longitudinal study designs are required for much of the 
research on change. 

In our research, the individual and the innovation serve as the basic 
frame of reference. Past research has focused on initial verification of two 
major dimensions of the CBAM that can be used to describe how individuals can 
develop as an innovation is being adopted. The dimension of Stages of Concern 
About the Innovation (3oC) addresses the individual's perceptions of the innova- 
tion and explain how concerns shift as the change process unfolds (Hall, George 
& Rutherford, 1977). The second dimension. Levels of Use of the Innovation 
(LoU), focuses on the behaviors of the individual and how he/she uses the inno- 
vation (Hall, Loucks, Rutherford & Newlove, 1975). Analysis of the components 
of an innovation serves as the third dimension of the diagnostic framework of 
the CBAM. The concept of Innovation Configurations (Hall & Loucks, 1981) 
describes how an innovation can be adapted and perhaps mutated by different 
users.^ These concepts have been studied extensively in past research. 

The CBAM Project's present research is expanding to include not only the 
individual front-line users and nonusers of innovations, but also the various 
actors who influence innovation use. The generic label "change facilitator" is 
used to refer to this role and function. Administrators, staff developers, 
evaluators, teacher educators, curriculum coordinators and many others can have 
as a part of their role the facilitating of change. The principal in particular 
has been frequently hlghliohted as the key change facilitatcr in a school. 
Brickell (1961) observed that although the principal may not be the source of an 
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innovation, her/his interest and active Involvement is essential to its initi- 
ation and implementation. Berman and McLaughlin (1978) have said that "the 
importance of the principal to both short- and long-run effects of innovations 
can hardly be overstated." They also have called the principal the "gatekeeper 
of change." The current evidence that principals influence the extent of imple- 
mentation is reviewed by Fullan (1980). Hall, Hord and Griffin of the CBAM Pro- 
ject analyzed nine case studies of change in elementary schools, and based on 
the data, hypothesized that "the implementation of the innovation was different 
in different schools primarily because of the actions and concerns of the prin- 
cipal." However, previous studies have not documented exactly what the princi- 
pal does to facilitate change, and that is the focus of current research by the 
CBAM Project staff. 

PURPOSE OF THE STUDY 

In the CBAM, it is proposed that the interventions of change facili- 
tators, including principals, should be targeted toward the needs of individual 
users based on their Stages of Concern, Levels of Use and the Configuration of 
the Innovation that is being used. In order to study these interventions, par- 
ticularly those of principals, it was necessary to develop ways to document the 
actions taken to facilitate implementation. One past study by CBAM had used 
ethnographic techniques to observe actions of individuals, both teachers and 
facilitators, involved in implementation. Ethnography produced data in quanti- 
ties, but the data were unfocused. Data reduction from protocols to usable data 
was difficult and time consuming to accomplish, and ethnographic data proved to 
be expensive not only to collect, but to analyze (Zigarmi & Goldstein, 1979). 
Self report procedures were seen as a viable alternative to ethnography. 
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With a sample of ten principals in central Texas, variations on procedures 
for having principals report their own interventions and those of others were 
piloted. To check on the validity of the self reports, teachers would be used 
to verify principal reports. Limited observation in the schools would also be 
used to collect data which would be imposible to get through principals' inter- 
views and logs. In this paper, these procedures and the methodology of the 
pilot study will be described, followed by an analysis of the relative strengths 
and weaknesses of the data collection procedures tested. After a discussion of 
these topics, the paper will conclude with a discussion of recommendations and 
issues concerning documentation of principal interventions. 

METHODOLOGY 

Sample 

The three-month pilot study sample consisted of ten principals;. two prin- 
pals were assigned to each of five self report procedures. Nine were principals 
of public schools; one served a private school. Three were female; number of 
years as a principal ranged from two to twenty years. The schools were located 
in several school districts in central Texas. All were elementary schools, as 
the major study would be done in elementary schools. Schools were selected to 
represent different phases of implementation, so the sample included the first, 
second, and third years of implementation of different curricula. 

Methods of Data Collection 

Variations of methods of collecting data were piloted in this study for the 

purpose of choosing a method or combination of methods for the national -level 

study. The intervention data we were particularly interested in were: 

1. What actions were taken by the principal or other change 
facilitator 
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2. Why they were taken 

3. What persons were the target of the actions 

4. When did the action occur 

5. How long did It take 

6. What were the effects of the action. 

A logging sheet Including these categories was developed and used for recording 
information collected (see Figure 1). 

Five variations in the procedures were developed and tested. Two princi- 
pals were assigned to each variation. These were: 

1. A written log was maintained on a weekly basis by the principal. Prin- 
cipals were asked to describe each of their own and other facilitators' inter- 
ventions by writing them on logging sheets, providing information in the six 
categories mentioned above. Principals were asked to mail their logs each week 
to our office in stamped, addressed envelopes provided by the project. 

2. A weekly report was submitted via audio tape. The procedure for this 
method was basically the same as for the written log, except that these princi- 
pals tape recorded their information rather than writing it down. They were 
asked to use the same categories as on the written log when making their tapes, 
and had a sample log sheet as a reminder of the information we were seeking. 
Tape recorders, tapes, and mailers for weekly submission of the tapes were pro- 
vided by the research project. A project staff member filled in log sheets 
based on the information on the tapes. 

3. Weekly reports were given on the telephone. On a designated day each 
week, project members contacted principals by telephone in order to obtain 
descriptions of interventions made by the principal or others the previous week. 
The project member probed for more information about actions mentioned by the 
principal, when necessary, to obtain complete data. These conversations were 
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PRINCIPAL LOti 



Name 



Figure 1 



IDP 2 



Week of 



Coding 

for 

R&D 

Use 



Date Target (s) 



Actions Taken: 
What Did You Do? 



Intent: 
Why Did You Do It? 



How Long 
Did Your 
Action . 
Take? 



What were 
the 
Effects? 



Ch 



Mall your log(s) each week to the UTR&D Center In the envelopes we have provided. 
ERIC 8 



taped (with principal permission) and interventions were transferred to log 
sheets by the project staff member. 

4. A face-to-face "Game Plan" interview was conducted. Once a month a 
project staff person visited the school and interviewed the principal about the 
interventions he/she had been making related to the specified innovation. The 
six Game Plan components of the Intervention Taxononiy were used to structuni 
this interview (Hord, 1981). For example, a question related to the Game Plan 
Component "Training" asked, "Have your teachers received ary training or other 
information about the innovation since our last interview?" Examples of 
interventions were provided in the interview to remind the principal of the type 
of information being sought. 

5. A face-to-face Stages of Concern Interview was conducted. This method 
was identical to Method 4, except that Stages of Concern were used to structure 
the interview questions. For example, teachers often express concerns about the 
management of an innovation. The SoC-based interview asks, "Have you noticed 
any problems with materials or management or use of the innovation? (Sched- 
uling, organizing, obtaining materials, managing time, etc.) How did you handle 
such problems when they surfaced?" 

At the end of the pilot study, for the final interview. Methods 4 and 5 
were combined and used with the four principals assigned to the two interview 
methods. This was done to see if richer data could be obtained with the combi- 
nation interview. These interviews were later compared to Methods 4 and 5. 

Training for Principals 

One of the R&D Center's staff was assigned to each principal to train the 
principal in the methodology and to be a contact person from the research pro- 
ject. In order for the principal to understand what the research was about, and 
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what the methodology entailed, the assigned researcher visited with the princi- 
pal at the school for one to two hours for a training session. After an over- 
view of the stucly design and purpose, each principal was Introduced to the def- 
inition of an Intervention and the levels of Interventions. Some examples of 
interventions were discussed so the principal would be better able to Identify 
which actions would be considered Interventions (see Figure 2). Then the as- 
signed procedure was explained, and a practice session was held, with the prin- 
cipal and the researcher playing their respective roles. A training packet (see 
Appendix A) was left with the principal for further reference, as well as ar\y 
materials needed for carrying out the assigned methodology. For example, the 
principals who were to tape record their Interventions had In their training 
packet a tape recorder provided by the research project, sufficient tapes for 
the duration of the pilot study, and stamped mailers addressed to the research 
project. Each principal was provided a calendar, with study-related dates mark- 
ed as reminders, and large enough spaces for each day so that notes could be 
kept on Interventions as they occurred. 

An additional purpose of the training session was for the researchers to 
meet and build some rapport with the principals; this was considered particular- 
ly necessary for those principals who would not be providing Information to an 
interviewer face-to- face. 

Teacher Interviews 

At the conclusion of the pilot study, three teachers from five of the 
sample schools (fifteen teachers total) were Interviewed to determine whether 
teachers recalled and could verify the interventions reported by the principals. 
The five schools represented all five methods of data collection. A staff mem- 
ber visited each randomly selected teacher and, after Introductory remarks, 
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PRINCIPAL LOG - SAMPLE SHEET 



Name 



Figure 



Week of 



Coding 
for 
R&D 
Use 



Date 



Target (s) 



Actions Taken: 
Wtiat Did You Do? 



Intent! 
Why Did You Do It? 



How Long 
Did Your 
Action . 
Take? 



V/liat Wcn-c 
titc 
Effects? 



10/24/77 



10/15/77 



All science 
teachers 



6th grade 
teachers and 
students 



At a staff meeting at the school, 
I encouraged teachers to take 
more field trips and utilize 
the area around the school for 
teaching science. 



I Ordered flat top tables for 
science room. 



Using the outdoors is 
part of new science cur- 
riculum, but teachers 
are not accustomed to 
this type of field trip. 



Science specialist sug- 
gested we need flat" top 
desks for microscopes 
and experiments. 



Mnll your 1oj'(h) each week to the UTR&D Center In the envelopes we have provided. 
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15 min. 



5 min. 



More field trips 
being taken. 



None yet they 
haven't arrived, 
but teachers be- 
ginning to realize 
the importance of 
teaching science. 
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asked this general question about the implementation of the innovation in their 
school: "Can you recall anything that has happened over the last three months 
that influenced, positively or negatively, your use of ( innovation )?" Then the 
teacher was asked other questions directed at determining if they could verify 
specific interventions which had been reported by their principal during the 
study. 

Debriefing of Principals 

At the conclusion of data collection, each participant in the study was 
visited at the school by a member of the project staff to discuss his/her reac- 
tions to participation in the study. The questions asked were: 

1. What was your general reaction to participating in the study? 

2. Did it cause any problems for you? 

3. What could have been done to make it easier? 

4. Now that you've had some experience with our project, what 
do you think would be the easiest and most efficient wa^ for 
you to share information with us? 

5. Approximately how much time per week did you spend on this 
task? 

6. Did your involvement in this study change, in any way, your 
actions or involvement with ? 

(Innovation) 

FINDINGS 

The data were analyzed to determine the effectiveness and efficiency of 
various methodologies in order to select the procedures to be used in the pro- 
posed major study which was to begin in May, 1980. Several aspects of the use- 
fulness of the data were considered: level of compliance of the subjects with 
the procedures; sufficiency, completeness and appropriateness of data; whether 
the method yielded bonus data; agreement between the principal's self report and 
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the teachers' verification of interventions; the satisfaction and comfort of 
both researchers and subjects in collecting the data; and finally, cost effici- 
ency. 

Compliance 

The person-to-person methods of telephone logs and in-person interviews 
resulted in more compliance than tne mail -in methods. All of the telephone logs 
and in-person interviews planned were completed. One principal who did written 
logs mailed in only one log; one principal who was assigned to tape interven- 
tions mailed in no tapes. There was no built in measure to insure compliance 
for those who were asked to mail in taped or written logs; however, three weeks 
into the data collection period, each principal who was not responding was 
called to see if they wanted to continue participating. Both responded that 
they would begin sending in data. 

Completeness and Appropriateness of Data 

Those methods that had ongoing person-to-person contact, even if not face- 
to-face, tended to produce more complete and appropriate data than the mail -in 
methods. Researchers were able to clarify the subjects' questions about inter- 
ventions and also to ask further questions when accounts were incomplete. The 
written logs and the tape recordings that were mailed in by principals generally 
contained information in all the categories on the log sheets; however, much was 
left unsaid about links between one intervention and another. The telephone 
logs resulted in abundant data on day-to-day interventions. The in-person in- 
terviews, like the telephone logs, yielded much information on day-to-day 
actions, while providing more information on long-range plans and strategies 
than did the telephone, taped, or written logs. 
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Bonus Date 

The 1n-person Interviews yielded very rich data, Including Information on 
background, philosophy, context, and reasons behind Interventions. On-site 
visits for Interviews also provided a limited opportunity to observe Inter- 
actions between principal and teachers or students. The other methods produced 
little bonus data. 

Agreement Between Teachers and Principal Reports 

All the methods used appeared to be valid In that teachers verified the In- 
terventions reported by the principals. When Interviewers asked teachers In the 
five schools questions aimed at verifying Interventions which had been reported 
by their principal, 39 out of the 40 Interventions targeted were confirmed by at 
least one teacher. The one uncomflrmed Intervention was the writing and mailing 
of a letter from the principal to an innovation facilitator outside the school; 
perhaps there was no opportunity for teachers to have learned of this action. 
Figure 3 indicates the percentages of Interventions verified by teachers In the 
various schools. Many factors would Influence the verification rate (types of 
Interventions reported, teacher-teacher communication In the school. Intervening 
style of the principal. Interviewer style), but the chart Indicates that the 
written log was the least successful method of documenting Interventions that 
would be observed and recalled by teachers. This was also the method which re- 
sulted In the unconfirmed Intervention. The other methods resulted In verifi- 
able data, with a variance among teachers In the number they recalled and con- 
firmed. 

Satisfaction and Comfort 

Interestingly, seven out of the ten principals said they were satisfied 
with the method to which they were assigned. The exceptions were three of the 
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Figure 3 

Percentage of Principal Reported Interventions 
Verified by Teachers 



Teacher 1 Teacher 2 Teacher 3 Overall 

Verification 

School 1 

(Telephone Log) m 100% 80% 86% 

School 2 

(Taped Log) 67% 100% 56% 74% 

School 3 

(SoC Interview) 67% 67% 83% 72% 

School 4 

(6P Interview) 80% 60% 73% 71% 

School 5 

(Written Log) 60% 40% 40% 46% 



ERIC 



17 



14 



* 



principals who were asked to mall In taped or written logs of their Interven- 
tions. Both principals In the taped log group said they would have preferred 
another method: this was demonstrated by an obvious discomfort with the method 
to which they were assigned. One did not complete the task and the other wrote 
out notes and had an aide read them Into the tape recorder. 

The personal Interview was thought to be the best method of documenting 
principals' actions by five of the participants; three favored the telephone In- 
terview; one preferred the written logs; one was not sure whether written logs 
or a personal Interview would have been best. One of those who said the per- 
sonal Interview would be best said, "The best way... Is to sit me down and ask me 
a question point-blank." On the other hand, one who preferred the telephone log 
said a principal would "feel more In command" on the telephone than In a per- 
sonal interview. Those who mentioned the telephone realized that It was more 
cost efficient than a personal Interview, and were In agreement that It would be 
best to meet the caller before being telephoned. It was also noted that a prin- 
cipal Is less likely to be Interrupted on the telephone or in a personal Inter- 
view than when writing or tape recording their Interventions. 

Researcher Reac t 1 on s 

7 

Since the research staff would be asked to collect similar Information from 
principals In the larger scale study, each staff member who participated In the 
pilot study was asked to report on his/her reactions to the methodologies. Most 
of the staff preferred the In-person interviews to any of the other methodolo- 
gies. Telephone logs were ',iext In comfort level for the researchers. Due to 
the limited Interpersonal contact with the principals, researchers found It most 
difficult to follow those principals with whom there was face-to-face contact 
only at the beginning and the end of the study. The researchers assigned to 
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principals who did not send in their tapes or written logs said they were uncom- 
fortable at the concluding debriefing session. 

Effect of Participation on Principals' Actions 

To what extent did participation in the research effort affect the princi- 
pals' actions? Each one was asked to respond to this question, and all agreed 
that it increased their awareness of their actions. However, five of the ten 
principals asserted that this increased awareness did not change what they 
actually did. Several said that they did not directly intervene more, but rath- 
er did more planning and "stayed on top of things a little more." Several said 
they consciously held back from intervening more than normal so that the re- 
search results would not be skewed. Only one was clearly motivated by partici- 
pation to introduce some new activities related to the innovation in ques- 
tion. 

DISCUSSION 

Contributions to the National Level Study 

The results of the pilot study of variations on procedures for documenting 
Interventions led us to conclude that a combination of logging and interviewing 
procedures might be used in our major study. Clearly there are some trade-offs. 
There is less richness in the data in comparison to pure ethnography, for exam- 
ple, but there are also gains in the areas of cost and data manageability. 

A hybrid logging/interviewing procedure was designed to incorporate many of 
the best features of the piloted variations. The results suggested that the 
ideal technique would include the following features: 

a) Data collected at regular intervals so that key information is 
not forgotten or lost. 

b) Some form of interviewing in order to fill out descriptions and 
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to stimulate recall or other happenings that might not have been 
recorded. 

c) The recording .Procedures could not be bt'-'densoine to the subjects. 

d) The procedures must facilitate obtaining Information about all 
parts of each intervention. 

e) The procedure must allow the subjects to provide elaboratlve data 
as well as data on the parts of Interventions. 

f) The procedure must be able to accommodate large geographic 
distances between the subjects and the researchers. 

g) The procedures must facilitate obtaining Information about 
all parts of each Intervention. 

h) There has to be a system for checking on single source reports 
of at least a sample of the overall set of interventions. 

The hybrid logging/interviewing procedure that was finalized and is being 
used in the major study Includes the following components: 

1) One research staff member assigned to each principal to provide 
continuity and to personalize the Interchange. 

2) A pre-dataj,collecting training session for principals and assistant 
principals^ to provide orientation toward the intervention levels 
and pdrts. 

3) Provision of a logging portfolio to principals that includes (a) a 
calendar, (b) samples of intervention recording sheets, (c) a synopsis 
of the intervention level definitions, (d) examples of interventions, 
and (e) the research staff liaison person's phone number and address. 

4) Bi-weekly phone calls to each principal. These phone calls are 
used to clarify past reports as well as to document the activities 
of the last two weeks. 

5) On-site visits at regular intervals (September, January and May) 
with focused interviewing of the principal. 

6) Audio tape recording of the phone calls and on-site visits by the 
research staff member. 



^In the pilot study, none of the schools had an assistant principal; in 
the 1980-81 study, in those sites with an assistant principal, he/she is treated 
as another key change facilitator and his/her Interventions are documented in 
the same way as the principal's. 
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7} Interviews with teachers and central office staff, during on-site 
visits, to nominate additional Interventions and to describe In 
their words the occurrences and effects of specific Interventions 
that the principals have Identified. 

8) Coding of each Intervention on a specially developed coding form 
by the research staff member. 

In our major study, the procedure appears to be providing a steady stream 
of usable data about the day-to-day Intervening that occurs as a change process 
unfolds In Individual schools. We are able to avoid the large data collection 
and data reduction costs of ethnography and at the same time have not created a 
major burden for the participating principals. 

However, some Issues were not resolved by the pilot study. Clearly, asking 
principals to record their Interventions leads them to thinking more about In- 
tervening. As odd as It may be, our tentative Impression from the pilot study 
and the nation-wide study Is that this does not appear to lead to a principal 
doing many more Interventions! The amount of Intervening and the type of 
Intervening done appears to be more closely related to what we call their change 
facilitating style, which Is the focus of our major study. 

Another Issue has to do with the depth of our Intervention sampling. It Is 
difficult to estimate how complete a sample of principal Interventions we are 
obtaining. Principals also might be doing a number of things that go unreport- 
ed. We may only be sampling the top third of the barrel or scraping the bottom. 
Without resorting to some form of ethnography we probably cannot develop an 
empirical answer to this issue. Our basic assumption then becomes that propor- 
tionately, we are sampling to the same depth for all principals. 
Other Implications 

In addition to contributing to the design of the major study, this research 
adds to the scientific knowledge of collection and analysis of qualitative data. 
In general, the study reinforces the effectiveness of self report as a method of 
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obtaining Inforinatlon on an Individual's actions. This Is not to sdy that self 
reporting does not have Its limitations. As mentioned previously, we cannot be 
certain that we have obtained data on ajl significant Interventions taken by the 
principal. However, the teacher Interviews, subsequent to the principal data 
collection, verified that Interventions that principals reported did, Indeed, 
happen. 

More specifically, the study suggests a number of things about how to in- 
crease the effectiveness of self reporting. First, interviewing with specific 
probes appears to stimulate the interviewee's memory of actions taken in the 
past. We found that merely asking principals, "What havb you done in the last 
few weeks related to this innovation?" was not as effective as questioning about 
actions in specific, functional categories such as training, scheduling, or con- 
ferring. There might be questions here about the tendency toward "yea- saying." 
Our experience with LoU interviewing and intervention interviewing suggests 
that when individuals are asked to be specific about their actions, this ten- 
dency is greatly reduced. 

Finally, this study reveals a number of benefits of personal Interaction 
between subject and researcher when self report is the mode of data collection. 
In addition to stimulating the memory of past action, personal contact Increases 
tendencies to comply with the study. Individuals are considerably more likely 
to remember or to keep notes on their actions if they know the researcher is 
going to call to collect the information than if they are required to mail in 
reports on their actions each week. Personal interaction also produces more 
appropriate and complete data than do a paper/pencil technique. The researcher 
can probe to fill in missing information as well as to clarify vague responses. 
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To sunvnarize our findings, this stucjy Indicates that self report Is a valid 
and effective method of collecting data on Individual actions, but personal In- 
teraction appears to be a necessary ingredient in producing this effectiveness. 
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Tho Reseoroh and Development Center for Teacher Education 

Universily of Texas Austin 78712 



August 1, 1980 



Dear Principal: 

This Is your packet of materials for use during the time of your participa- 
tion In the study. B will be your primary contact at the R&D Center for 
Teacher Education and will be talking to you on a regular basis during the 
school year. If you have any questions, please feel free to call either of 
us collect, at 512/471-3844. 

In this packet we have Included an overview of the study procedures and a 
description of the task we would like you to do. We have also enclosed 
several references In case you have Interest In learning more about some of 
thi? concepts we have researched before. 

We believe that Individual administrators are an Important source of Infor- 
mation for understanding the ways In which education Is changing and how the 
process can be facilitated* We sincerely appreciate your help and are look- 
ing forward to the opportunity to share experiences with you this year. 

Sincerely, 



District Coordinator School Coordinator 



/jm 
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I. STUDY OVERVIEW 



PRINCIPAL -TEACHER INTERACTION STUDY 
Conducted by CBAM Project, Texas R&D Center 



The Texas R&D Center 

The Texas R&D Center U one of seven university-based research centers 
that are funded by the National Institute of Education (NIE). Each center 
has a different research emphasis, ours being teacher education, both pre- 
servlce and Inservlce. 

Several different research projects are housed within the Texas R&D 
Center. Our project Is studying the change process In schools and colleges. 
We have had several different project names; however, we are usually referred 
to as the Research on Concerns -Based Adoption Project or the "CBAM" (pronounced 
"see-bam" as In "shazam") Project. CBAM stands for Concerns -Based Adoption 
Model. 



The Focus of CBAM Research 

This model Is the conceptual basis for our studies. In this model and 
our work, the Importance of the individual Is emphasized. We believe that 
teachers and administrators should not be viewed as one large vague group 
and always treated the same. We believe that just as Individual children 
are different. Individual teachers and administrators are different. In our 
CBAM research we are attempting to understand and describe these individual 
differences and to point out to decision makers how Important it is to attend 
to individual differences when designing staff development activities, planning 
and facilitating change, and evaluating the effects of new instructional ap- 
proaches. 

The focus of our research is on the change process , and we do mean process. 
We believe that change takes time and entails developmental growth for the 
teachers and administrators who are Involved. We also believe that change is 
not accomplished by simply having a two-day "God bless you" workshop before 
school opens or by having an administrator send out a memo announcing the change. 



The Design of CBAM Research 

In the studies we have done in the past, as in this study, we believe that 
we need the assistance and insight of teachers and administrators who are ax- 
periencing the use of new approaches. Our research requires two-way interaction. 
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We just can't send out questionnaires and then process the returns with a 
computer. We need to talk to Individuals and try and learn from their ex- 
periences. 

Also, It Is Important to point out that we are doing descriptive re- 
search, not Improvement research. Improvement research Is designed to prove 
that one way (the treatment group) Is better than another way (the comparison 
or control group). Descriptive research, on the other hand. Is designed to 
describe what happens and to try and make sense out of It. There are no 
experimental and control groups; rather, the focus Is on observing and de- 
scribing what happens In "naturalistic" (I.e., the real world) settings. 



The Study 

In the study that we are asking you to help us with we want to look at 
the whole school at It Is Involved In using a new program. In our past 
studies, we have focused on what happens to teachers as they adoDt new In- 
structional materials and philosophies. Now we would like to look at the 
building principal as well. 

The literature Is filled with general statements that the principal Is 
Important. However, there are extremely few descriptions of what principals 
do. In this study we would like to watch how teachers and their principal 
work to Implement a new approach or maintain an existing program. The study 
will focus on describing the experiences and concerns of teachers and their 
principal. 

We feel that we can learn the most from studying a range of Innovations 
and school settings. As a result we are planning to work with three schools 
In each of three different school districts. That way we can also understand 
the effects of the central district office, the particular community setting, 
and the kind of program being used. 



Data Collection 

Of course we need to collect data. We have planned our data collection 
so that It will take a minimum of your time (a maximum of 3 hours for teachers 
and 8 hours for the principal, over the school year). We want to disturb the 
school day as little as possible. To do this we will ask you to complete 
brief questionnaires at your convenience, and three times a year we would like 
to interview each teacher for no more than thirty minutes. In an interview 
we can more quickly learn about your individual experiences. The combination 
of a questionnaire and a short Interview will keep your time to a minimum. 
We would like to tape record the interviews so that we can transcribe them 
later. 
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We also plan to talk with each principal by telephone on a regular basis 
so that we can keep In touch with what Is happening between our scheduled 
visits. 



Data Sharing 

Confidentiality of data Is always a concern. We have a standard set of 
policies about who does and who does not see the data. In this study we will 
use the following policies: 

1. Individuals have access to their own data upon request. 

2. Only I. D. numbers will be kept In our data files, thereby 
prohibiting anyone accessing individual data in the future. 

3. No one outside the school building will see individual's 
(teachers or principal) identified data unless the indi- 
vidual grants permission. 

4. During the period of the study (possibly two years) building 
principals will have access to data about the "concerns" of 
their teachers in relation to their "use" of the new approach. 
No other data will be shared with the principa'i without teacher 
approval . 

5. Any information that teachers or building administrators 
provide the research effort, that is asked to be held in 
confidence will be. 

6. Use of the data for the purposes of personnel evaluation is 
expressly prohibited. 

We want to put these points in writing to Indicate our feelings of responsi 
bility as researchers. We can only learn if you are willing to share with us. 
This means that we have a major responsibility to merit your trust. 

The one point that might heed to be restated is our plan to share with 
each principal brief descriptions of what we call Stages of Concern and Levels 
of Use of the Innovation. We think that providing principals with some feed- 
back can aid them in being more helpful in facilitating change and can help 
us better understand how teachers and their principal together exoerience the 
change process. 
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II. CONCEPT OF INTERVENTIONS 



In order for you to understand what we are looking for in our telephone 
and face to face Interviews, we would first like to introduce you to the con- 
cept of interventions. 



Definition of Intervention 

There are many definitions of intervention depending on the field in 
which it's being used. Some are simple and some are complex. We found it 
necessary to develop a definition of intervention which would be consistent 
with our purposes ~ to study interventions in relationship to implemen- 
tation of innovations. The working definition offered here is a result of 
extensive staff debate and analysis: 

An intervention is an action or event, or a set of actions 
or events, that influences use of the innovation. An 
event is distinguished from an action in that an event does 
not have an intervenor. The key criteria for an intervention 
are: 

1) there is action(s) or event(s) and, 

2) an effect on use of the innovation is 
observed or there is the potential for 
an effect on innovation use. 

In some cases, lack of an action which impacts use of the 
innovation can be classified as an intervention, e.g., 
failure to send a memo to decision makers. 



Levels of Interventions 

In order to talk about interventions in a more specific way, we've de- 
veloped the concept of "levels" of interventions. Levels distinguish inter- 
ventions on the basis of scope, duration, and number of individuals affected. 

For example, an incident is a singular occurrence of an action or event. 
It is the smallest intervention unit — incidents are characteristically small 
in terms of time involved and number of individuals involved. 

Examples: In order to let parents know about the new science 
curriculum, the school science specialist makes a 
presentation about it at the PTA meeting on 
September 16, 1977. 

Due to a snowstorm on January 20, 1977, the super- 
intendent cancels classes, and the after-school in- 
service for teachers planned for that day had to be 
rescheduled. 
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The principal and two change facilitators from 
the local university met on September 26, 1976, 
to revise the Student/Faculty Handbook, In order 
to make It more consistent with the new Discipline 
Strategies being adopted at the school. 

A tactic Is an aggregation of Incident Interventions that. In combination, 
have an effect that Is different or larger than the effects of the in- 
dividual Incidents. 

Examples: During the fall of 1976, each week the principal 
publishes reminders of Inservlce days and dead- 
lines for ordering materials in the bulletin for 
teachers. 

For the first semester of implementation, the 
innovation advisors consult on a regular basis 
with individual teachers, in their classrooms, 
about specific discipline problems they en- 
counter. 

As you see, duration and scope of tactics are likely to be larger than those 
of incidents. 

A strategy is even larger than a tactic. It usually covers a large portion of 
the implementation period and Impacts most, if not all, of the individuals 
using the innovation. Strategies translate assumption and theory into prac- 
tice. 

Examples: During the course of the implementation period, each 
teacher and administrator from the junior high school 
attends a workshop with William Glasser, the developer 
of Reality Therapy, to enhance their understanding 
and appreciation of the technique. 

The district equips each school with new science 
kits^ equipment and books and arranges to ensure 
that films and consumable materials would be 
available to each teacher to use with the new 
science curriculum. 

A strategy is a major part of the overall design for implementing an inno- 
vation. This overall design of a change effort is called a game plan . A 
' game plan may be specified in advance or inferred in retrospect. 

Example: The district phases in a new science curriculum 
for the elementary schools, providing orientation 
for administrators, training for teachers, and 
equipment and materials for each school, with 
subsequent evaluation of the program. 

The interventions we have described are generally initiated by an admin- 
istrator, staff developer, or someone else in authority. We realize that 
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there are other actions or events that Influence the change effort: district 
level decisions (reassigning a principal), natural occurrences (a hurricane), 
teachers' actions (tuachers sharing Ideas about the innovation), etc. We 
consider these to be interventions also. 

We Introduced you to the concept of "levels" of Interventions so that you 
would have an idea of the range of things we would consider to be interventions. 
What we would like you to do is describe interventions, both your own inter- 
ventions and those of others (district coordinators, teachers, parents, etc.). 
However, we do not expect you to decide which level they fall under. In most 
change efforts we've studied, the majority of interventions have been at the 
incident level. 
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III. HOW TO DESCRIBE INTERVENTIONS 



Parts of an Intervention 

From our experience 1n analyzing Interventions, we have found that cer 
tain elements are necessary to describe one: 

WHO : Who initiated the action and who was the target(s)? 

WHAT: What was actually done by the initiator? (a 
description of the action) 

WHERE: Where was it done? 

WHEN : When was it done (date) and how much time did It 
invol ve? 

WHY ; What happened that led to the action? What was 
its intent or purpose? 

EFFECTS ; In addition to describing Interventions » we would also 
like to know something about the effects of these in- 
terventions (to the extent that they can be observed 
or inferred) 
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PRACTICE 



Instructions: Read the following excerpt from an ethnographer's account of 
a change effort in a junior high school. Pick out and de- 
scribe the interventions. 



On several occasions the principal has acted as a model for how Reality 
Therapy works. On the last day of the inservice workshop she ran a demon- 
stration class meeting. One teacher's comment was that the principal was 
sensitive during the workshop to the pressure faculty members were feeling 
about the beginning of school. When I interviewed the principal, she said 
that teachers were feeling that they were supposed to take on more than 
they did last year and that they had concerns like "I need to have order" 
or "I need to have structure and you are asking me to accept less than I 
would normally expect from students in the classroom." In particular, 
the principal felt that staff members were confused about her expectations 
for them during the upcoming year. She felt that they needed some ground 
rules, that they had to know what they were getting into in greater detail 
than the "theory" provided them with. The principal felt that conducting 
the demonstration class meeting helped to assure faculty members that thsy 
didn't have to change their mode of operation, that they simply had to do 
something in addition to what they normally did in responding to students. 
She said that she felt that the class meeting had this effect. She also 
talked with individual faculty members in conferences reaffirming that they 
really don't have to change as much as they may think they have to. Once 
again, the principal said that through the class meeting she helped clarify 
for faculty members what she expected from them. 

A second way in which the principal used herself as a model for the Reality 
Therapy strategies was that she practiced the strategies herself on the 
first day of school and then related the success that she had to faculty 
members as she met them in the halls or in the lunchroom. Apparently, on 
the first day of school she was involved in an incident with a student in 
the lunchroom. She asked the student to describe what she had done and 
what she might have done differently. This particular interaction with the 
student occurred right near the fapulty table in the lunchroom. The 
principal related that she was thrilled with the response that she got 
from the student and that she found it easier that she had thought to get 
kids to admit to what they had done. When she sat down to lunch with faculty 
members, she enthusiastically shared the response that she had gotten. She 
told me that the effect that this had on faculty members was that they could 
also acknowledge that they had tried the strategies and could admit whether 
or not they had been successful . 



WHO WHAT WHERE WHEN WHY 
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Date 


Who Did It? 


Who Was the 

Target 
(or Targets)? 


Action Taken: 
What Was Done? 


Intent: 
Why Was It Done? 


How Long 
Did the 
Action 
Take? 


What Were the Effects? 


? 


Principal 


Teachers at 
inservice. 


Demonstrated a class 
meeting at inservice 
workshop. 


To relieve pressure on 
teachers and their con- 
fusion about what was 
expected of them. 


? 


Helped assure faculty 
members that they didn't 
have to change, Just 
do something in addition 
to what they were used 
to doing. 


? 


Principal 


Individual 
teachers. 


Had conferences. 


To reaffirm that they 
didn't have to change as 
much as they thought 
they had to. 


? 


Helped reassure faculty 
and clarify expectations. 


1st Day 

of . 
School 


Principal 


Student and 

teachers 

watching. 


Principal used 
Reality Therapy with 
student in lunch- 
room. 


To discipline student 
and model technique 
for teachers. 


? 


Principal excited about 

response from student. 


1st Day 

of 
School 


Principal 


Teachers in 
lunchroom. 


Principal enthusi- 
astically shared 
response from 
students . 


To share successful 
use of Reality Therapy. 


? 


Teachers would know they 
could discuss successes 
and failures with Reality 

1 ncrapj • 
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PROCEDURES: INTERVIEWS AND CALENDAR 



We have enclosed a calendar for the 1980-81 school year for your use 
In recording Interventions. We are Interested In what ^ have done, as 
well as actions taken by others such as teachers or district personnel. 

During the week, please jot down reminders of interventions on the 
dates they occur. Your Interviewer will call you on the telephone every 
two weeks to ask you questions centered on these Interventions — such as, 

a. the specific date 

b. what happened that led to the intervention 

c. a description of the action(s) taken 

d. the reasons (purposes/Intent) for doing It 

e. the amount of time spent on this action 

f. the effects of the actlons(s). 

After each calendar page there Is space to allow for elaboration of the 
Interventions noted. Information on this section of the page may help you 
recall the details of Interventions when talking to the Interviewer. An 
example of calendar notes and elaboration is provided on the next page. 

In addition to the telephone calls, your interviewer will visit you 
at your school three times during the school year. These Interviews will 
involve the same questions. In greater depth. 
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NOVEMBER 1979 

4 



SUNDAY 


MONDAY . 


TUESDAY 


WEDNESDAY 


THURSDAY 


FRIDAY 


SATURDAY 


4 


5 


6 

staff meetl ng 


7 


Q 
O 


Q 


in 


11 


12 

ordered tables 


13 


14 


1^ 

1 U 


ID 


1 / 



Date 


Who Did It? 


Who Was the 
Target (or Targets) 


Action Taken: 
What Was Done? 


Intent: 
Why Was It Done? 


How Long 
Did the 
Action 
Take? 


What Were the 
Effects? 


11/6 
11/12 
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Principal 

• 

Principal 
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All science teachers. 

Sixth grade teachers 
and students. 


At a staff meeting at 
the school, I en- 
couraged teachers to 
take more field trips 
and utilize the area 
around the school for 
teaching science. 

I ordered flat top 
tables for science 
room. 


Using the outdoors 
Is part of the new 
science curriculum, 
but teachers are not 
accustomed to this 
type of field trip. 

Science specialist 
suggested we need 
flat top desks for 
microscopes and 
experiments. 


15 min. 
5 min. 

40 


More field trips 
being taken. 

• 

None yet "they 
haven't arrived, 
but teachers 
beginning ttf 
realize the 
Importance of 
teaching 
science. 
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Data Collection Sunmary (each year of project*) 

Teachers 

Teacher SoC, Loll. Innovation Configuration (15 minute questionnaire, 30 
minute Interviewl 

3 times: May '80, October '80, April '81 

School Climate and Principal Leadership Style (45 minute questionnaire) 
1 time: January '81 

Interventions Made on Teachers (selected teachers, 30 minute interview) 
1 time: January '81 

Total time: 3 hours max. 



Principal 

Principal Interventions (20 minute phone call interviews and up to three 
one-hour visits on-site ) 

Every other week: August '80 - May '81 

Principal Concerns (15 minute questionnaire) 
3 times: May '80, October '80, April '81 

Schofll Cliinate and Principal Leadership Style (45 minute questionnaire) 
1 time: January '81 



Total time: 8 hours max. 



e project is presently planning a one year study, but we would like to 
ep open the option of returning for a second year. 
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